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Abstract — The multi-way relay channel (MWRC) models coop- 
erative communication networks in which many users exchange 
messages via a relay. In this paper, we consider the finite field 
MWRC with correlated messages. The problem is to find all 
achievable rates, defined as the number of channel uses required 
per reliable exchange of message tuple. For the case of three users, 
we have previously established that for a special class of source 
distributions, the set of all achievable rates can be found [Ong 
et al., ISIT 2010]. The class is specified by an almost balanced 
conditional mutual information (ABCMI) condition. In this paper, 
we first generalize the ABCMI condition to the case of more than 
three users. We then show that if the sources satisfy the ABCMI 
condition, then the set of all achievable rates is found and can 
be attained using a separate source-channel coding architecture. 

I. Introduction 

This paper investigates multi-way relay channels (MWRCs) 
where multiple users exchange correlated data via a relay. More 
specifically, each user is to send its data to all other users. There 
is no direct link among the users, and hence the users first 
transmit to a relay, which processes its received information 
and transmits back to the users (refer to Fig. [TJ. The purpose 
of this paper is to find the set of all achievable rates, which 
are defined as the number of channel uses required to reliably 
(in the usual Shannon sense) exchange each message tuple. 

The joint source-channel coding problem in Fig. [T] includes, 
as special cases, the source coding work of Wyner et al. ID 
and the channel capacity work of Ong et al. J5). Separately, 
the Shannon limits of source coding [ 1 1 (through noiseless 
channel) and of channel coding |2| (with independent sources) 
are well established. However, these limits have not yet been 
discovered for noisy channels with correlated sources in general. 
For three users, Ong et al. gave sufficient conditions 
for reliable communication using the separate source-channel 
coding paradigm. The key result of |3| was to show that these 
sufficient conditions are also necessary for a special class of 
source distributions, hence giving the set of all achievable rates. 
The class was characterized by an almost balanced conditional 
mutual information (ABCMI) condition. This paper extends 
the ABCMI concept to more than three users, and shows that 
if the sources have ABCMI, then the set of all achievable rates 
can be found. While the ABCMI condition for the three-user 
case is expressed in terms of the standard Shannon information 
measure, we will use /-Measure JH Ch. 3] for more then three 
users — using Shannon's measure is possible but the expressions 




Fig. 1. The finite field MWRC in which L users (nodes 1, 2, . . . , L) exchange 
correlated messages through a relay (node 0). The uplink channel is marked 
with solid lines and the downlink channel with dotted lines. 

would be much more complicated. 

Though the ABCMI condition limits the class of sources for 
which the set of all achievable rates is found, this paper provides 
the following insights: (i) As achievability is derived based on 
a separate source-channel coding architecture, we show that 
source-channel separation is optimal for finite field MWRC 
with sources having ABCMI. (ii) Since ABCMI are constraints 
on the sources, the results in this paper are potentially useful for 
other channel models (not restricted to the finite field model), 
(iii) This paper highlights the usefulness of the /-Measure as a 
complement to the standard Shannon information measure. 

II. Main Results 
A. The Network Model 

1) Sources: Consider m independent and identically 
distributed (i.i.d.) drawings of a tuple of correlated 
discrete finite random variables (W\, W2, ■ ■ ■ , Wl), i.e., 
{(Wi[f], W%\t\, • • ■ , The message of user i is given 
by W i = (Wi[l],W i [2],...,W i [m}). 

2) Channel: Each channel use of the finite field MWRC 
consists of an uplink and L downlinks, characterized by 

Uplink: Y Q = X 1 ®X 2 ®---®X L ® N l (1) 

Downlinks: Y l = X © N h for all i 6 {1, 2, ... , L], (2) 

where Xi, Ye, Ni, for all I £ {0, 1, ... , L}, each take values in 
a finite field T, denotes addition over T, Xt is the channel 



input from node £, Yg is the channel output received by node 
£, and Ne is the receiver noise at node I. The noise Ng is 
arbitrarily distributed, but is i.i.d. for each channel use. We 
have used the subscript i to denote a user and the subscript I 
to denote a node (which can be a user or the relay). 

3) Block Codes (joint source-channel codes with feedback): 
Consider block codes for which the users exchange m message 
tuples in n channel uses. [Encoding:] The i-th transmitted 
channel symbol of node £ is a function of its message 
and the (t — 1) symbols it previously observed on the 
downlink: X t [t] = f t [t]{W t , Y t [l], Y e [2], . . . , Y e [t - 1]), for 
all £ e {0,1, . . . , L} and for all t £ {1,2,..., n}. As the relay 
has no message, we set Wo = 0- [Decoding:] The messages 
decoded by user i are a function of its message and the symbols 
it observed on the downlink: (Wj % : V? G {1, . . . , L}\{i}) = 
hi(Wi, Fi[i]»*i[2], . . . , Yi[n]), for all i £ {1,2, ... , L}. 

4) Achievable Rate: Let P e denote the probability that 
7^ Wi for any i ^ j. The rate (or bandwidth expansion 

factor) of the code is the ratio of channel symbols to source 
symbols, k = n/m. The rate k is said to be achievable if the 
following is true: for any e > 0, there exists a block code, with 
n and m sufficiently large and n/m — k, such that P e < e. 

B. Statement of Main Results 

Theorem 1: Consider an L-user finite field MWRC with 
correlated sources. If the sources {W\, W%, . . . , Wl) have 
almost balanced conditional mutual information (ABCMI), 
then k is achievable if and only if 

H(W {1 , 2 ,...,L}\{i}\Wi) 



K > 



max 



(3) 



ie{T,2,.:,L} log 2 |J1 - max{H(N ),H(Ni)}' 
The ABCMI condition used in Theorem Q] is rather technical 
and best defined using the /-measure Ch. 3]. For this reason, 
we specify this condition later in Section 
a brief review of the /-measure in Section 



III-B| after giving 
III-A| For now, it 



suffices to note that it is a non-trivial constraint placed on the 
joint distribution of (W\, W2, ■ ■ ■ , Wl). 

The achievability (;/ assertion) of Theorem [T] is proved 
using a separate source-channel coding architecture, which 
involves intersecting a certain Slepian-Wolf source-coding 
region with the finite field MWRC capacity region [2|. The 
particular source-coding region of interest is the classic Slepian- 
Wolf region (5) with the total sum-rate constraint omitted; 
specifically, it is the set of all source-coding rate tuples 
(ri,r 2 , . . . , r L ) such that 



>H(W s \W {h2 .... M \ S ) 



(4) 



holds for all strict subsets Sc{l,2,...,L}. The next theorem 
will be a critical step in the proof of Theorem [T] 

Theorem 2: If L arbitrarily correlated random variables 
(W\,W 2 , . . . ,Wl) have ABCMI, then we can find a non- 
negative real tuple (n, r 2 , ■ ■ ■ , Tl) such that 
[CI] the inequality Q holds for all subsets Sc{l,2,...,£} 

for which 1 < \S\ < L - 2, 
[C2] the inequality Q holds with equality for all subsets S C 
{1,2,..., L} for which \S\ = L - 1. 



Remark 1: Theorem [T] characterizes a class of sources (on 
any finite field MWRC) for which (i) the set of all achievable 
rates is known, and (ii) source-channel separation holds. 

Remark 2: Slepian-Wolf type constraints of the form Q 
appear often in multi-terminal information theory. Since 
Theorem [2] applies directly to such constraints, it might be 
useful beyond its application here to the finite field MWRC. 

Remark 3: To prove Theorem [2] we need to select L non- 
negative numbers that satisfy (2 L — 2) equations. 

III. Definition of ABCMI 

A. The I-Measure 

Consider L jointly distributed random variables (W\, W 2 , 
. . . , Wl)- The Shannon measures of these random variables can 
be efficiently characterized via set operations and the /-measure. 
For each random variable Wi, we define a (corresponding) set 
Wi. Let Tl be the field generated by {Wi} using the usual 
set operations union U, intersection n, complement c , and 
difference — . The relationship between Wi and Wi is described 
by the /-Measure ^* on F L , defined as [4, Ch. 3] 

(j,*(Ws) = H(W s ), (5) 
for any non-empty S C {1, 2, ... , L}, where Ws — UieS ^ 
and W s = {W l :i£ S}. 

The atoms of Tl are sets of the form f]f =1 Ui, where Ui 
can either be Wi or W\. There are 2 L atoms in Tl, and we 
denote the atoms by 

a(/C) 4 p| Wi - (J Wj, (6) 

ieK jeic c 

for all K. C {1, 2, . . . , L] where JC = {1, 2, . . . , L} \ JC. Note 
that each atom corresponds to a unique K C {1,2,...,L}. For 
the atom in |6]), we call \JC\ the weight of the atom. 

Remark 4: The /-measure of the atoms corresponds to the 
conditional mutual information of the variables. More specifi- 
cally, [i*(a(K,)) is the mutual information among the variables 
{Wi : i £ JC] conditioning on {Wj : j G /C c }. For example, if 
L = 4, then ^*(a(l,2)) = I{W 1 ;W 2 \W 3 ,W 4 ), where /(•) is 
Shannon's measure of conditional mutual information. 

B. Almost Balanced Conditional Mutual Information 
For each K £ {1, 2, . . . , L — 1}, we define 



u K = max u*(a(K,)) 

/CC{1,2 L} 

s.t. \K\=K 

a Tr = min n*(a(K,)), 
- K KC{1,2,....L} v v " 
s.t. \K\=K 



(7) 

(8) 



i.e., atoms of weight K with the largest and the smallest 
measures respectively. With this, we define the ABCMI 
condition for L random variables: 

Definition I: {W\,W 2 , .. ., Wl) are said to have ABCMI 
if the following conditions hold: 

Vl-i < K L -i { l + f^r 2 



and 

~Pk — A* 



K 



1 



for all K G {2, 3, 

a(L, S, K) 4 S 



where 



/8(L, 5, A") ^ S 



mm — ) r 

K — l [se{K,K+i,...,L-2} a(L, S, K ) 

. L — 2}, where 

V)-<*-< 



(9) 
(10) 



\KJ ~ K\{S~K)\- 

Remark 5: The ABCMI condition requires that all atoms of 
the same weight (except for those with weight equal to zero, 
one, or L) have about the same /-measure. 

Remark 6: For any L, S, and K, such that 2 < K < S < 
L - 2, it can be shown that a(L, S, K) > (3(L, S, K) > 0. 

Remark 7: For L = 3, we have Jx 2 < 2/i 2 , i.e., we recover 
the ABCMI condition for the three-user case 0. 

IV. Proof of Theorem|2] 

For the rest of this paper, we are interested in atoms only 
with weight between one and (L — 1) inclusive. So, we define 
K = {JC C {1, 2, . . . , L} : 1 < \K\ < L - 1} and refer to 
A = {a(K) : V/C £ 1} as the set of all such atoms. 

We propose to select (r 1; r 2 , . . . , r£) in terms of the I- 
Measure: 



= E J *w, 



(id 




-&_V(a(/C)), 



if ie/c 

otherwise, i.e.. 



if i G /C c . 



Each r, 
coefficient 



is chosen as the sum of the weighted (by a 



L-l 



or — ^_ 1 1 ) /-measure of all atoms in A. 
The assignments of r^'s are depicted in Fig. [2] We term Jj(/C) 
the contribution from the atom a(/C) to r.;. Each contribution 
is represented by a cell in Fig. [2] and each r; by a column. 

We now show that conditions CI and C2 in Theorem [2] hold 
when the fj's are chosen as per ( fTT| >. 

A. For |<S| = L — 1: 

We first show that for any i G {1,2,..., L}, we have 

E r i =ff(W {1 , 2 ,„., L} \ W |Wi). (12) 
je{i,2,...,i}\{i} 

Since r/s are defined in terms of /-Measure, we link the 
measure of atoms to the entropies of the corresponding random 
variables: 

H(W s \Ws>) = n*{W s - W&) (13a) 

E M>(/C)), (13b) 

non-empty /CC5 

where ( |13a| i follows from [4 eqn. (3.43)], and (|13b[ ) is obtained 
by counting all the atoms in the set (Wg — Ws°)- 

This means the RHS of (V2\ equals 

non-empty /CC{1,2,...,£}\{»} A t *( a (^))- 

















1 
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i 



a(/C) 



1.1 



: e 5 



i G {1,2,..., L} 

Fig. 2. Each row represents the contributions from a unique atom, and 
is the summation of all cells, i.e., {Ji(-)}, in the i-th column. The hashed 
region shows the contributions from all atoms with weight K to all r;'s for i 
in some set S. 



We now evaluate the LHS of ( fT2| ) for some fixed i. Consider 
some atom a(K) where i ^ JC. We evaluate the contributions 
from this atom to r~ % = {rj : j G {1, 2, . . . , L} \ {«}}, i.e., 
one specific row in Fig. [5] less the cell Jj(/C): 

. \K\ of the (L - 1) cells each contribute ^^n*{a{K)). 
• The remaining (L — 1 — \fC\) cells each contribute 

_&_V (a(/C )). 

So, summing the contributions from a(JC) to r~ l , we have 

E w 



L - 1 



//(a(/C)) (14a) 



L - 1 

= //>(£)). (14b) 

Consider some atom a(/C') where i G JC 1 . The contributions 
from this atom to r -4 are as follows (again, one specific row 
in Fig. [2] less the cell Ji(fC')): 

• (\IC'\ — 1) of the (L — 1) cells each contribute 

• The remaining (L — \fC'\) cells each contribute 
-Jig=V(a(/C')). 

So, summing the contributions from a{JC') to r~\ we have 

E W) 



(|/C'| 



1 



L-|/C'| 



(i - |/c 



L-l v 1 "L-l 
Combining the above results, we have, for a fixed i, 

E r i 

je{i,2,...,L}\{i} 



IM*(a(JC')) = 0. 



E 

3G{l,2,...,i}\{i} 

E v*^)) 

s.t. i^/C 



E E • / ^ /c ') 



/cgk 

s.t. i4K 



s.t. iG/C' 



(15a) 
(15b) 



/**(<*(£)) (15c) 

non-empty /CC{l,2,...,L}\{i} 

= H(W {l! 2 : ... tLy \ {i} \Wi). (15d) 
B. For 1 < |5| < L - 2: 

Consider some 5 C {1, 2, . . . , L} where 1 < |«S| < L — 2. 
We now show that if the ABCMI is satisfied, then 



> H{W S \W SC ) 



ies 



E 



(16a) 
(16b) 



H*(a(tC)). 

non-empty KQS 

Define S = \S\ and r s = {n : i <= 5}. The LHS of ( fT6a| > 
is the sum of contributions from all atoms in A to all € r 5 . 
We will divide all atoms in A according to their weight if: (i) 
if = 1, (ii) 2 < X < S, and (iii) if > 5 + 1. So, we have 

x: w+EE E w 



ieS ieS /CeK 

s.t. |/C| = 1 

L-l 



ieS A'=2 /CeK 

s.t. |JC|=K 



E E E 

ies k=s+i /csk 

s.t. |K|=Jf 



(17) 



1 ) Atoms with weight if = 1: For atoms with weight one, 
V(a(£)), if/C = {?:} 



Ji(/C) = 



0, 



otherwise. 



(18) 



Summing the contributions from all atoms with weight one to 
all Ti € r s , 



E E W) = E M*(a(/C)). 



(19) 



ies /CeK 
s.t. |/c| = 



/CCS 
s.t. |/C|=1 



[02] 



(i-x-i) contributions with coefficient —j^j [from 

L f'^ 1 _ 1 ) ways to select the 



,L}\{i}]. 



L ^ atoms with weight if. We can check that 1 L 



K) 



atoms where i & JC C ; there are 
other (L— if — 1) elements in JC C from {1,2 
There are 

( L K-\) + ( L -K-x) 

Since observations 01 and 02 are true for each £ r s , we 
have the following contributions from all atoms with weight 
if to r s (the hashed region in Fig. There are 
[03] S ■ contributions with coefficient 7^rr » an d 

[04] S ■ { L ^_^) contributions with coefficient -j^t- 

For an atom a(JC), we say that the atom is active if JC C 5; 
otherwise, i.e., JC ^ S, the atoms is said to be inactive, 

Consider the contributions from a particular active atom 
a{JC) to r 5 (one row in the hashed region in Fig. |2|. We have 
the following contributions from this atom to r s : 
[05] Since JC C 5, if cells in the hashed row each contribute 



[06] The remaining (S — if) cells each contribute 

-f^X/c)). 

Summing the contributions from this active atom to r s , 



ies 



Mic) 



K- 



.L-K 
L- 1 ~ 



(S -if) 



if - 1 



L - 1 



/i*(a(/C)) 



l)(if-l) 



L — 1 



/i*(a(/C)). 



For any fixed 5, there are (^) active atoms with weight if 
(different ways of choosing JC C 5), and observations 05 and 
06 are true for each active atom. Combining 03-06, we can 
further categorize the contributions from all atoms with weight 
if to r s : 

[07] Out of the S ■ contributions with coefficient 



if • 



y K j of them are from active atoms. 
[08] Out of the S ■ ( L ^ ] _ 1 ) contributions with coefficient 
— j^zj, (S — if)( if ) of them are from active atoms. 
Now, summing the contributions from all (active and inactive) 
atoms with weight if to r s , we have 



2) Atoms with weight 2 < if < S: We fix if. Consider the 
contributions from all atoms with weight if to a particular r,, 
i G S (one column in the hashed region in Fig. |2j. There are 
[01] contributions with coefficient j^f [from atoms 

where i £ JC; there are ( K ZX) ways to select the other 
(if - 1) elements in JC from {1, 2, ...,£} \ {i}], and 



E E -M*o = E E w+E E miq 

ies /ccs 

s.t. \K\=K 

(L-S-1)(K-1) 



ies /CeK 

s.t. \K\=K 



its ic£s 

s.t. |/C|=K 



E 



/CCS 

s.t. |/c|=ir 



L - 1 



H*{a{K)) 



Mic) 



> 



E E 

ies /c^s 
s.t. \K\=K 



/CCS 
s.t. \K\=K 



S\{L_ 
K 



S-1)(K -1) 



L- 1 



if - 1 

X - 1 
L-K- 1 



-if • 



L - 1 
L-K 



E M*(a(£)) 



/CCS 
s.t. \K\=K 



L 

-(5-if)- 
if - 1 



-(^-i ), 

L - 1 



(21a) 
(21b) 



where 

'7 = 



A" 



a(L,S, K)/j, K , 



a(L,S,K) + — _ 1 

where 5, if) is defined in ((9} and /3(L, S, if) in ([10}. If 
the ABCMI condition is satisfied, then 77 > 0. 

3) Atoms with weight S + 1<K<L — 1: Consider the 
contributions from all atoms with weight if to for some i. 
From observations 01 and 02, we know that there are 

• Ck— 1) contributions with coefficient L £i^ , and 

• contributions with coefficient —j^j- 
Summing these contributions, we have for any i that 

E J >(v 

/CeK 

s.t. \K\=K 



> 



L—1\L — K 



(L-2V. 



(L-K- l)\K\ 



K/j, 



K 



L-l \-(K-l)_ 
L - 1 

> 0. 



L-K-l 
-(K-1)Jl k 



(22) 



Since a(L,S,K) > fi(L,S,K) > 0, the ABCMI condition 
implies that ~p, K < 1 + j)—r fi 



{2, 3, . . . , L — 1}. Hence, the inequality in ( |2"2"| l follows. 

4) Combining the contributions of A to r s : Substituting 
{L9), ( |2Tb] >, and (|22j into ([17), if the sources have ABCMI, 
then 

5 

5>> E M*(a(£)) + E E 

s.t. |K| = 1 s.t. \K\=K 

= H(W S \W S <). 
This completes the proof of Theorem [2] ■ 

V. Proof of Theorem Q] 

A. Necessary Conditions 

Lemma 1: Consider a finite field MWRC with correlated 
sources. A rate k is achievable only if <[3j holds for all i G 
{1,2,. ..,£}. 

Lemma 1 can be proved by generalizing the converse 
theorem [6, Appx. A] for L = 3 to arbitrary L. The details 
are omitted. 

B. Sufficient Conditions 

Consider a separate source-channel coding architecture. 

1) Source Coding Region: We have the following source 
coding result for correlated sources: 

Lemma 2: Consider L correlated sources as defined in 
Section II-A1 1 Each user i encodes its message W i to an 
index M[ G {1,2,..., 2 mr '}, for all i. It reveals its index to 
all other users. Using these indices and its own message, each 
user i can then decode the messages of all other users, i.e., 
{W 3 : Vj G {1,2, .... L} \ {i}}, if <@ is satisfied for all 
non-empty strict subsets S C {1, 2, . . . , L}. 

The above result is obtained by combining the results for 
(i) source coding for correlated sources J71 Thm. 2], and (ii) 
the three-user noiseless MWRC [i, Sec. II.B.l]. Note that the 
relay does not participate in the source code, in contrast to the 
setup of [1|. Instead, the relay participates in the channel code. 

2) Channel Coding Region: We have the following channel 
coding result for the finite field MWRC 0: 

Lemma 3: Consider the finite field MWRC defined in ([T]i- 
|2]). Let the message of each user i be Mi, which is i.i.d. and 
uniformly distributed on {1, . . . , 2 nRi }. Using n uplink and 
downlink channel uses, each user i can reliably decode the 
message of all other users {My : Vj G {1,2, . . . , L} \ {i}} if 



E 



R 3 <log 2 \T\-m^{H(N ),H(N t )}, (23) 



■ : : / : i<: 

for all i G {1,2,.. . , L}. 



3) Achievable Rates: We propose the following sepa- 
rate source-channel coding scheme. Fix mr^ = nRi. Let 
(D-y, . . . , Dl), where each Di is i.i.d. and uniformly distributed 
on {1, . . . , 2 mTi }. We call Di a dither. The dithers are made 
known to all users. User i performs source coding to compresses 
its message Wj to an index M[ G {l,...,2 mri } and 
computes Mi = M[ + Di mod 2 mri . The random variables 
(Mi,..., Ml) are independent, with Mj being uniformly 
distributed on {1, . . . , 2 nRi }. The nodes then perform channel 
coding with Mi as inputs. If ( |23| > is satisfied, then each 
user i can recover {Mj : Vj G {1, ...,£} \ {«}}, from 
which it can obtain {M- : Vj G {1, ...,£} \ {i}}. If |4]) is 
satisfied, then each user i can recover all other users' messages 
{Wj : Vj G {1, ...,£} \ {i}}, using the indices M-'s and its 
own message Wi. This means the rate k — n/m is achievable. 
Using the above coding scheme, we have the following: 
Lemma 4: Consider a finite field MWRC with correlated 
sources. If there exist a tuple (ri, r%, . . . , Vl) and a positive 
real number k such that Q is satisfied for all non-empty 
strict subsets S G {1, 2, ... , L}, and ([23]) is satisfied for all 
i G {1, 2, . . . , L} with Ri = r t / 'k, then the rate k is achievable. 

C. Proof of Theorem^(Necessary and Sufficient Conditions) 

The "only if" part follows directly from Lemma[T](regardless 
of whether the sources have ABCMI). We now prove the "if" 
part. Suppose that the sources have ABCMI. From Theorem [2] 
there exists a tuple (ri, . . . ,Tl) such that conditions CI and 
C2 are satisfied. These conditions imply that Q is satisfied for 
all non-empty strict subsets S C {1,2, . . . ,L}. Let Ri = ri/n. 



Condition C2 further implies k = ^ 



H(W {1 



\Wi) 



--. So, if 

,€{1,2 !,...,Z,}\{i} n i 

is true, then ( |23| ) is satisfied for all i G {1,2,..., L}. From 
Lemma [4] k is achievable. ■. 

Remark 8: For a fixed source correlation structure and 
a finite field MWRC, one can check if the L-dimensional 
polytope defined by the source coding region and that by the 
channel coding region (scaled by k) intersect when k equals 
the RHS of ([3J. If the regions intersect, then we have the set of 
all achievable k for this particular source-channel combination. 
Theorem Q] characterizes a class of such sources. 
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